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arc of occupancy, by itself a very fuzzy image of the world. Sev- 
eral hundred readings together produce an image with a resolution 
often better than 15 centimeters, despise many aberrations in indi- 
vidual readings t Figure 3). The resiliency of the method has been 
demonstrated in successful multi-hour long runs of Denning robots 
around and around long trajectories, using ihiee second map build- 
ing and three second map matching pauses at key intersections to 
repeatedly correct their position. These runs work well n clutter, 
and survive disturbances such as people milling around the running 
robot 

Xen Stuart of MIT and Woods Hole mis .mpiememed a three 
dimensional version of the sonar mapper for use with small sub- 
mersible craft Tested so far only in simulation, but in the oresence 
of large simulated errors. Stuart’s program provides extremely t,ood 
reconstructions. :n a \ZS « 128 < 64 uTay. of large scale terrain, 
working with about 60. (X)0 readings from a sonar transducer with 
a seven degree beam. Running on a Sun computer, his program can 
process sonar data fast enough to keep jp with the approximately 
one second pulse rate of 'he transducers on the two candidate suo- 
mersibies at Woods Hole. 

Recently Serey and Matdues demonstrated :he utility of the gnd 
representation in a stereo vision oased navigator [!J. Edges cross- 
ing a particular scaniine in the two stereo .mages are matched by 
a c>ru*miv programming method. o prixt-cc i 'ir.ge cron’. \ The 
wedge shaped space from die camera to the range profile is marked 
empty, cells along the proiilc itseif ire maned occupied. The re- 
sulting map is then used to pian obstacle avoiding paths as with 
the stereo and sonar programs mentioned a Dove i Figure -th 

Despite its effectiveness, m each nstancr we adopted :he gnd 
representation of space reluctantly. This may reject harms r'rom 
a recent time when analytic approaches were mere feasible and 
seemed more elegant because computer memories were too small to 
easily handle numerical arrays of a few thousand to a nuL* on ceils. 
I dunk the reluctance _s x> longer aopropr.ate. The straightfor- 
wardness. generality and uniformity x the grid representation has 
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proven itself in hmte eiement approaches o problems in physics, 
n raster based approaches to computer graphics, and has the same 
promise in roboac spatial representations. At hrsx glance a grid’s h- 
nite resolution seems inherently to limit positioning accuracy. This 
impression is false. Cameras, sonar transducers, laser scanners and 
other long range sensors have intrinsic uncertainties and resolution 
Urn its that can be matched by gnds no larger man a few hundred 
ceils on a side, giving l few thousand cells in two dimensions, or x 
few million in three dimensions. Since the accuracy of most trans- 
ducers drops wrh range, even greater economy is possible by using 
a heiraichy of scales, covering the near held at high resolution, and 
ucceisi'-c.y argernrges *;th .rKTeasingiy : curse r nods. 3esicrs 
this, die implicit accuracy of a certainty gnd can be better than die 
size of its ceil. The gnd can be thought of as i discrex sampling 
of a continuous : uncoon. Exxnded features such as lines < perhaps 
representing wails \ may be located to high precision by examining 
the paramexrs of surfaces of best liL The Denning robot navigator 
mentioned above convolves rwo maps to rind the displacement and 
rotation between them. In the final stages of the matching correla- 
tion values are obtained for a number of positions and ingles in the 
vicinity of the oest march. A quadratic least squares polynomial :s 
ritxd to the correlanoo values, and us pea* is ocared analytically. 
Controiled tests of the procedure usually give awmons accurate to 
betxr than one quarter of a ceil width. 
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Figure 4: Stem Mapptef aad Navgatwa - ?ten vie* of the certainty gnd 
built by a stereo guided robot traversing oir laboratory. Tbe situation a anak> 
job to Ac sonar case of Ftgwc 3, bid Ac range probles we gathered frora t 
scaniuK stereo method using two TV c a m er as rxber Am a sonar nng. 


Our results to suggest that many mobile robot asks can 
be solved with this unified, sensor independent, approach to space 
modelling. The key ingredients are a robot centered, multi reso- 
lution, map of the robot’s surroundings, procedures for efficiently 
inserting data from sonar, stereo vision, proxunny and other sensors 
into the map. other procedures for updating the map to reflect the 
uncertainties introduced by ur. precise robot mocon, and yet oth- 
ers to extract conclusions from the maps. We're already demon- 
strated procedures that produce local and global navigational fixes 
and obstacle avoiding paths ftvm such maps. Other tasks, suer 
as tracking corridors, finding \ mage points with good views of 
unseen regions, and idennficaDon of larger fcarses such as doers 
and desks by general shape seem within reach. 


3 The Representation 

The sonar mappers mentioned above are our most thorough use to 
date of the certainty grid idea. Although our xtginal implemen- 
tations used two grids to represent occupancy icow ledge (labeilec 
? ^ JJ and Stuart’s 3D system uses omy one. An analysis 

of *he iters n our code reveals that one pr.d vill miced suffice, 
ind this simplification makes c ear several puzaung -ssues in me 
original formulation. 

Before any measurements are made. Ac zrd is imdaiized a 
i background occupancy certain ry value. Cb. "his number rep- 
resents Ac iverage occupancy certainty we tvxci in a mature 
map, and encodes a ivery) little bit of a-pr.on juormanon we hare 
about the world In our Lab i good Cb seems x> be about the 
number of ceils in die perimeter of the gnd uvided by the too. 
ceils 4 x 32. (32 x 32) = I/S) in the case of rte Denning cooc. 
If die space s very ci uttered. Cb should be arger. .As the mar 
is used, values near Cb will stand for regions those occupancy 
staie s essennaily unknown, * rule these mucr nearer zero v- 





represen t empty places, and those much nearer unity axe likely to 
be occ u pied. Most of the planning algorithms chat use the grid 
will be better off if they do not make sharp distinctions, but in- 
stead numerically combine the certainty values from various cells 
to produce "goodness of fit** numbers for their various hypotheses, 
la this way the essential uncertainties in the measurements are not 
masked, and the algorithms do not jump to unnecessary, possibly 
false, conclusions. 

4 Inserting Measurements 

The readings of almost any kind of sensor can be incorporated 
into a certainty grid, if they can be expressed in geometric terms. 
The information from a reading can be as minimal as a proximity 
detector's report that there is probably something in a certain region 
of space, or as detailed as a stereo depth profiler’s precise numbers 
on the countours of a surface. 

The first step, in general, is to express the sensor’s measurement 
is a numerical spaaal certainty distribution commensurate with the 
grid’s geometry. For an infrared proximity detector this may take 
the form set of numbers P t in an elliptical envelope with high 
certainty values in a central axis 'meaning detection is likely there) 
tapering to zero at the edges of the illumination envelope. Let’s 
suppose the sensor returns a binary indication that there is or is 
not something in its held of view. If the sensor reports a hit. ceils 
in the certainty grid C x falling under the sensor’s envelope can be 
updated with the formula 

C x t = C x ■+■ P t — C g x P z 

which will increase the C values. In this case ’die P values should 
be scaled so their sum is one, since die measurement describes a 
situation where there is something somewhere in the field of view, 
probably not everywhere. If the reliability of the sensor is less than 
perfect, the normalization may be :o a sum less than unity. If. on 
the otner hand, the detector registers no hit, the formula might be 

Cx := Cx < 1 - Pz) 

and the Cs wiil be reduced. In this case the measurement states 
mat there s nothing anywhere in me field of view, and the P values 
should reflect only the chance that an object has been overlooked at 
each particular position; i.e. they .mould not be .normalized. If the 
sensor returns a continuous value rather than a binary one. perhaps 
expressing some kind of rough range estimate, a mixed strategy' 
similar :o the one described below for sonar is called for. 

A Polaroid sonar measurement is a number giving the range of 
the nearest object -within an approximately thirty degree corse in 
front or the sonar transducer. Because of the wide angle, the co- 
ject position is known only ;o be somewhere cn a certain surface. 
This range surface can be handled in the same manner as the >en- 
5 icvity distribution of a proximity aetector ’*hit'* above. The ionar 
measurement has something rise to sav. however. The volume of 
■.he cone ip *o the range reccing s -rrrudy empty. r.re ; -m.a.Icr 
range *ould have been returned- The empty volume s iike the 
‘no hit'* proximity detector case, and can be handled in the >ame 
rashion. So a sonar reading is iike a proximity ce teeter hit at some 
ocarcns. and increases the occupancy prooaoiiity there, and fike 
a miss at others, wncre ;r decreases the prooaciiiry. If we have a 
large numeer of sonar readings taxen from different vantage points 
say as the robot moves), me gradual accumulation of <uch cer- 
tainty numoers wall build a respectaole map. Ae can. :n tact, do a 
little reiter than that. Imagine two <cnar readings whose volumes 
mtersect. And suppose the 'empty * region of me recond overlaps 
car. of the range surface of the first. Now *hc range rurrace uvs 


“somewhere along here there is an object", while the empty vol- 
ume says “there is no object here". The second reading can be 
used to reduce the uncertainty in the position of the object located 
by the firs* reading by decreasing the probability in the area of the 
overlap, and c o rr es pondingly increasing it in the rest of the range 
surface. This can be accomplished by reducing the range surface 
certainties R, with the formula R t R t x (1 - E t ) where E, is 
the “empty" certainty at each point from the second reading, then 
normalizing the Rs. This method is used to good effect in the ex- 
isting sonar navigation programs, with the elaboration that the £s 
of many reelings are first accumulated, and then used to condense 
the Rs of the same readings. (It is this two stage process that led 
us to use two grids in cxir original programs. In fact, the grid in 
which the £s are accumulated need merely be temporary working 
space.) 

The stereo method of Serey and Matthies provides a depth pro- 
file of visible surfaces. Although, like a sonar reading, it describes 
a volume of emptiness bounded by a surface whose distance has 
been measured, it differs by providing a high certainty that there 
is matter at each point along the range surface. The processing of 
the “empty" volume is the same, but the certainty reduction and 
normalization steps we apply :o sonar range surfaces arc thus net 
appropriate. The grid cells along a very right distribution around 
die range surface should simply be increased in value according 
to the “hit" formula. The magnitude and spread of die distribu- 
tion should vary according to the confidence of the stereo match 
at each point. The method used by Serey and Matthies matches 
edge crossing alon^ .orre spending scaniines of two images, and is 
likely to be accurate at those points. Elsewhere it interpolates, and 
the expected accuracy declines. 

If the robot has proximity or contact sensors, its own motion 
can contribute to a certainty grid. .Areas traversed by the robot are 
almost certainly empty, and their cells can be reduced by the “no 
hit" formula, applied over a confident sharp edged distribution in 
the shape of the robot. This approach becomes more -interesting if 
the robot’s mocon has inherent uncertainties and inaccuracies. If 
the certainty grid is maintained so it is accurate with respect to the 
robot's present position (so coiled robot co-ordinates i, then the past 
positions of the robot will be uncertain in this co-ordinate system. 
This can be expressed by jiumr.% the certainty grid accumulated 
from previous readings in a certain way after eacn move, to reflect 
the uncertainty in that move. New readings are inserted without 
clur essentially the robot is saying “I know ->.ur:/v where I am 
row; I’m just not sure where I was before). The rack in the 
cenainty gr.d of a moving robot’s path in this system will resemble 
the vapor trail of a high flying jet - right and dense n the vicinity of 
the robot, diffusing eventually to nothing with true and distance. 

5 Extracting Deductions 

The curpose of maintaining a crrrainty grid in ore rooot is to pi an 
ir.d monitor letters. Theme tre zlfes -howee :*re *ay *o plan 
restacie avoiding paths. Conceptually the gnd can be considerec 
an array of topographic values * high occupancy ;ertaint:es are 
hills *niie .ow certainties ore vadeys. A sale parii fodows valleys, 
uke running water. A relaxation agonthm can perturo ponions o; 
a tnai path to bring each pan to a local minimum. In pnnc.pie 
i decision reed never be made is to which ociuens ire a c ready 
empty' and which are occupied, though perhaps ire program should 
stop it the rest path dimes re>crd some threshold “altitude". If 
-he moots sensors continue :o crerate and create the end as the 
path :s executed, .mpasses will re-come obvious is proximity one 
contact e risers raise the xcuparcy certainty :f locations where 
trey max? rentact *uh <oiid miner. 



As indiciTrd in the introduction, we have already demonstrated 
effective navigation by convolving certainty grids of given loca- 
tions built at different times, allowing the robot to determine its 
location with respect to previously constructed maps. This tech- 
nique can be extended to subpam of maps, and may be suitable 
for recognizing particular landmarks and objects. For instance, 
we arc presently developing a wall tracker that fits a least squares 
line to points that are weighted by the product of the occupancy 
certainty value and a gaussian of the distance of the grid points 
from in a-priori guess of the wail location. The parameters of the 
least squares line are the found wall location, and serve, after be- 
ing transformed for robot modon. as the initial guess for the next 
iteration of the process. 

For tasks that would benefit from an opportunistic exploration 
of unknown terrain, the certain ry grid can be examined to find 
interesting places to go next. Unknown regions are those whose 
certainty values are near the background certainty Cb. By applying 
an operator that computes a function such as 

V ( c. - Cb ) 1 

over a weighted window of suitable size, a program can find re- 
gions whose contents are relatively unknown, and head for them. 
Other operators similar in spirit can measure other properties of 
the space and the robot's state of knowledge about il Hard edged 
charactenzadons of the stuff in the space can be left :o the iast 
possible moment by this approach, or avoided altogether. 

6 A Plan: Awareness for a Robot 

Uranus is the CMU Mobile Robot Lab’s latest ana best robot and 
•he third and last one we intend to construct for the forseeable 
future. About 60 cm square, with an omnidirectional dnve sys- 
tem intended primarily for indoor work, Uranus carr.cs two racks 
wued for the industry' standard VME com outer bus. and can be 
upgraded with off the shelf processors, memory and muut output 
boards. In the last few years the speed and memory available on 
single beards has begun to match that available in our mainframe 
computers. This removes the mam arguments for operating the 



"igure 5: The Uranus Mobile - A V-mimg Mty. u.l :( itefnae. 


machine primarily by remote control With most computing done 
on board by dedicated processors, enabling very high bandwidth 
and relaible connection of processors to sensors and effectors, real 
time control is much raster. .Also favoring this change in approach 
is a realization by us. growing from our experience with robot con- 
trol programs from the very complex to the relatively snnple, that 
the most complicated programs are probably not the most effective 
way to learn about programming robots. Very complex programs 
are slow, limiting the numebr of experiments possible in any given 
time, and they involve too many simultaneous variables, whose 
effects can be hard to separate. A manageable intermediate com- 
plexity seems likely to get us to our long term goals fastest. The 
most exciting element in our current plans is a realization that cer- 
tainty grids are a powerful and efficient unifying solution for sensor 
fusion, modon planning. landmark identification, ind many other 
central problems. 

As the core of the robot and die research we will prepare a 
kind of operating system based on die ^certainty grid” idea. Soft- 
ware running continuously on processors onboard Uranus will 
maintain a probabilistic, geometric map of ±e robot’s sur- 
roundings as it moves. The certainty grid representation will allow 
this map to be incrementally updated in a uniform v,ay from var- 
ious sources including sonar, stereo vision, proximity and contact 
^nsors. The approach can correctiv model die fuzziness of each 
reading, while at the same tune combining multiple measurements 
to produce sharper map features, and it can deal correctly with un- 
certainties in the robot’s mocon. The map will be used by planning 
programs to choose clear paths, identify locations by correlating 
maps), identify well known and insufficiently sensed terrain, and 
perhaps identify objects by shape. To obtain both adequate res- 
olution of nearby areas and sufficient coverage for longer range 
planning, without excessive cost, a hierarchy of maps will be kept. 
;he smallest covering a 2 meter area at 6.2 5 cm resolution, die 
largest 16 meters it 50 cm re sol u con (Figure 6). This map viil 
be “ scrolled” to keep die rooct eerie red as it moves, but rotations 
of the robot wii] be handled by changing elements of a matrix the 
represents die robot’s orientation in die grid. The map forms a 
kina of consciousness of the world surrounding the rooot - reason- 
ing about the world would actually oe done by computations :n the 
map. It might be interesting to take one more step in the hierar- 
chy, to a one meter grid that simply covers the robot’s own extent. 
It would be natural to keep this final grid oriented with respect 
to robot chassis itself, rather than approximately to the compass as 
with die other grids. This c range of co-ordinate system veuid pro- 
vide a natural disuncuon between "world” awareness ana "body" 
or “seif” awareness. Such encoding of a sense of seif mi gr.t even 
be useful if the robot were covered with many sensors, cr pemaps 
were equipped with manipulators. A'e have no immediate nans in 
hat direction, and so wail pass by his interesting dea for new. 

Our initial version wail rontain a pair of two timenr.or.ai end 
set s, one mapping me presence of oojects ui me roocts roeranng 
■eight cr" a few feet aboe mound ’eve!. The other will mao me ess 
complex :cea or presence of passac.c door a: various .councils. The 
object map will be updated mom ail sensors, the fioor mao pnmar- 
ily from downward locking proximity detectors, meugn possibly 
also from long range data from vision and sonar. The robot wail 
navigate by dead reckoning, integrating he mcr.cn ?r 3 v reels. 
This method accumulates error rapid v. and his uncertainty be 
retieexd m he maps by a repeated biurr.ng operation. Old reac- 
mgs. *nose location relative :o me robots ore sent rosinon and 
orientation are known with cecreasing precision, will rave me: r 
effect gradually df fused ?v this pe ration, until mey eventually 
evaporate :o me background certxnty value. 
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Figure 6: Map Resolution Heirarcby - Coarse macs far ibe big pKnire. line 
ones for ihe iddly :n ihe jnmediate environment. Ail the maps are 

scrolled to keep the robot in ’he center cells. 

It would be natural :o extend the two-grid system to many grids, 
each mapping a particular vertical slice, until we have a true three 
dimensional grid. We 'will do this as our research results, and 
processing power permit The availability of single board array 

processors that can be installed on the robot would help this, as 
the certainty gnd operations are very amenable to vectorizing. The 
certainty gnd representation can also be extended in the time di- 
mension. with past certainty grids being saved at regular intervals, 
like frames in a movie dim. and registered to the robot’s cunent 
co-ordinates (and blurred for motion uncertainties). Line operators 
applied across :ne time dimension could detect and track moving 
objects, and give the react a sense of time as well as space. This 
has some very mnlling conceptual ; and perceptual') consequences, 
but we may not get to it for a while. 

Even die simplest versions of die idea wall allows us fairly 
straightforwardly to program the robot for tasks that have hitherto 
been out of reacn. We look forward to a program mat can explore a 
region and return to its starting piace, using map ‘snapshots" from 
its outbound journey to and its way back, even in the presence of 
disturbances of is mccon and occasional manges in the terrain. 
3y funneiing the sensor readings through a certainty grid, which 
collects and preserves ail die essential data, and indications of un- 
c trainees, and makes .t avadable in a uniform way, we avoid the 
rroolem we've cad. that for each combination of sensor and task a 
afferent program is required. Now the as* execution is decoupled 
from the sensing, and mus becomes simpler. 
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